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The document evaluates Navy Mental Group Four 
personnel gains in competency of basic communication and 
computational skills after taking the Practical Arithmetic Self-Study 
course. Categorized as Group Four by receiving scores from the 10th 
to the 30th percentile on the Armed Forces Qualification test, 
trainees received instruction in computational skills up to a ninth 
grade level of difficulty through three technigues: audio 
instruction, minimizing direct assistance, and increasing time of 
study. Audio instruction technigues included reducing reading 
requirements and the visual complexity of presentation, with neither 
method improving test scores. Withdrawal of assistance and extension 
of training time were combined technigues that produced improvement 
in test scores, less than half of the trainees involved in the study 
were able to achieve a ninth grade level, making their performance of 
typically required computational tasks of Navy enlisted men 
uncertain. More effective training approaches will have to be 
developed along with a determination of the nature of difficulties 
experienced by Group Pour personnel. Tabulation of. test results are 
included and the arithmetic operations quiz, attitude questionnaire 
results, and evaluation of audio techniques, and a sample of standard 
and audio versions of course material are appended. (IH) 
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FOREWORD 



This research was performed under Work Unit Number MMPB SD.03 
(Methodology for Efficient Training of Lower Mental Level Personnel"^. 
It was initiated in response to a request from the Department of De- 
fense to determine the training potential of Navy Mental Group IV 
personnels The data presented in the present study were collected 
over the period from May of 1969 through June of 1970s A discussion 
of the scope and objectives of the larger research effort from which 
the present study developed is presented in PRA SRR-69-12: The 
development and evaltiation of training methods for Group IV personnel; 
!• Orientation and implementation of the Training Methods Develop- 
ment School (IMPS) by John Steinemann, October, 1968. 
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Commanding Officer 
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SUMMARY AND CONCLUSIONS 



Problem 

Currently, many personnel entering the Navy are unable to demon- 
strate the degree of competency in basic communication and com- 
putational skills necessary to succeed in most Navy ratings. 
To utilize these personnel productively, new and more effective 
training methods are needed. 

Background and Requirements 

Military personnel with preinduction scores on the Armed Forces 
Qualifications Test (AFQT) that fall within the 10-30 percentile 
range are categorized as Group IV. Because of the Navy's concern 
with difficulties experienced in training these personnel, an in- 
vestigation is being conducted to determine the nature of their 
*aif f iculties and to identify optimal approaches for improving 
training effectiveness. As part of this effort, a "self-study" 
course in mathematics was developed and found to be effective. 
The present investigation varies conditions of presentation and 
examines resulting levels of criterioa achievement. 

Approach 

Students were administered the Practical Arithmetic Self-Study 
(PASS) course, a collection of instructional materials develop- 
ed for use with Group IV subjects. PASS covers computational 
skills up to a ninth grade level of difficulty. Three types 
of modifications were introduced and evaluated. These included 
providing audio instruction, minimizing direct assistance, and 
increasing study time. 

Findings 

By using PASS course materials, approximately one full grade 
level of improvement was achieved with 15 to 24 hours of instruc- 
tion. Supplementing or replacing portions of printed instruction 
with audio presentations did not increase gains but may have 
caused some trainees to work with greater independence. Elimina- 
tion of direct assistance from instructors was achieved without 
a corresponding decrease in performance, and attitudes remained 
generally positive. Increasing training time from 15 to 24 hours 
allowed more trainees to complete more of the coursework and re- 
sulted in significantly higher gains. However, only about half 
of the trainees achieved a ninth grade level of performance, which 
was considered necessary for the types of skills Group IV personnel 
would be expected to perform within the Navy. Few of those whose 
initial level of performance was below the seventh grade level 
achieved a ninth grade criterion performance regardless of how 
much coursework they completed. It was concluded that remedial 
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training methods are not yet effective enough to provide many of 
the Navy's Group IV personnel with an adequate background in 
general computational skills. Alternatives for dealing with 
such performance deficiencies are discussed. 
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COMPUTATIONAL ACHIEVEMENT OF GROUP IV TRAINEES WITH A SELF-STUDY FORMAT: 
EFFECTS OF INTRODUCING AUDIO, WITHDRAWING ASSISTANCE, AND 
INCREASING TRAINING TIME 



A. Introduction 
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Personnel whose preinduction test scores on the Armed Forces 
Qualifications Test (AFQT) fall within the 10-30 percentile range 
are categorized as Group IV personnel. Since such personnel are 
typically deficient in such basic academic skills such as reading, 
writing, and arithmetic computation, they often perform poorly in 
Navy training situations. 

An experimental facility was implemented for observing and evaluat- 
ing Group IV performance under controlled conditions (Steinemann, -1968) 
At this facility, training programs were developed and evaluated. 

This is the third in a series of reports concerning the develop- 
ment and evaluation of methods for training Group IV personnel in 
basic mathematical operations. From an initial assessment of perfor- 
mance, it was determined that an individualized approach was required 
(Main, 1969). This led to the development, of the Practical Arithmeti c 
Self-Study (PASS) course, which has subsequently been published as 
an instructional manual (Main, 1973). Through the use of PASS course 
materials. Group IV trainees achieved significant performance gains 
with approximately 15 hours of study time. 

Instructional gains are not, however, the only basis for judginf> 
the adequacy of an instructional program. Gains produced through 
remedial instruction must be balanced against the effort involved in 
producing them. Reports of success in remedial training are often 
disappointing when the magnitude of the effort is considered. For 
example, sponsors of a 3h month high school summer program to pro- 
vide remedial instruction to volunteer minority students reported 
gains in computational performance of half a grade level as being 
highly successful (Steptoe, 1967). 

Even where gains can be produced with relative efficiency, re- 
sulting levels of performance may still be unsatisfactory. Jensen 
(1969) has noted that, in terms of producing meaningful changes in 
scholastic achievement, most remedial training programs must be 
considered unsuccessful. In the case of the PASS course, a ninth^ 
grade level of computational performance vras selected as a criterion 
for training effectiveness. This criterion was considered to be a 
meaningful level of performance since the skills involved are relevant 
to such tasks as recipe conversion and measurement of linear dimen- 
sions, the types of tasks which Group IV personnel might be expected 
to perform while in the Navy. Unfortunately, despite the achieve- 
ment of significant gains, a sizable proportion of the Group TV 
sample was unable to achieve a ninth grade criterion on completion 
of training (Main, 1969). 
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Since the initial presentation of PASS course instruction did 
not produce the desired levels of achievement, an attempt was made 
to identify efficient methods for enhancing the effectiveness of 
this training. Results of an unsuccessful attempt to increase gains 
by supplementing PASS course materials with an application of flash 
card instruction have already been published (Main, 1970). In the 
present study, a number of other modifications were introduced and 
evaluated. These included the introduction of two types of audio 
instruction and changes in training time and levels of instructor 
assistance. The purpose of the study was to determine (1) whether 
these modifications can improve the effectiveness of PASS course 
instruction, and (2) whether the resulting remedial program will be 
sufficiently effective to raise performance to criterion levels of 
proficiency. 

B, Experiment I: Audio Supplement 

The introduction of an audio format of presentation was based 
on evidence that Group IV personnel could improve their computational 
performance when the verbal content of arithmetic word problems is 
simplified or eliminated (Main, 1969). Since audio instruction 
could be used to reduce reading requirements, it was reasoned that 
its adoption into the PASS course might facilitate learning. 

1. Method 

a. Subjects . All of the Group IV trainees who participated in 
the following experiments were Navy enlisted personnel who had just 
completed recruit training. Thirty-three trainees participated in 
Experiment I. Their AFQT percentile scores ranged from 11 to 28, 
with a mean of 19.2. 

b. Materials . The basic instructional materials used through- 
out this study were contained in the PASS course. They included 
(1) a series of 25 separate lessons covering operations with whole 
numbers, fractions, decimals, and percentages, and (2) computations 
involving units, formulas, linear equations, and ratios. Back-up 
materials were also provided to keep students occupied if they 
finished the course in less time than that allowed for the experi- 
ment. 

In this first experiment, audio tapes were prepared that re- 
peated the instructions and explanations found in the written course 
materials. Two sets of computational operations were selected for 
taping: Lesson Set F covered operations v7ith fractions and Lesson 
Set D covered operations with decimals and percentages. 

Two tests were used to evaluate performance. One of these, the 
USAFI III Arithmetic Computational Test, is commonly used by th*: 
military services to establish performance levels for marginal per- 
sonnel. It has the advantage of providing scores which may be 
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converted into school grade achievement levels up to the ninth grade. 
Two parallel forms (A and B) were used in this experiment. The 
other test, the Arithmetic Operations Quiz (AOQ) , was specifically 
designed to parallel the USAFI test items and allow a more thorough 
diagnostic evaluation of student performance. A copy of the AOQ 
is displayed in Appendix A. 

Lesson Set F included 12 items from the USAFI test and 11 items 
from the AOQ test. Lesson Set D included 9 items from the USAFI 
test and 14 items from the AOQ test. From the performance of pre- 
vious classes, it had been established that the levels of difficulty 
of the test items covering the two sets of audio instruction were 
roughly equivalent. 

The questions developed to assess trainees* attitudes and level 
of motivation are included in Appendix ft. 

c. Procedure . Participants were from four differenct train- 
ing sections, each consisting of eight or nine trainees. Each 
section was trained separately, receiving 3 hours of instruction 
per day for 5 days. After the first and second hours of instruction, 
a 10-minute study break was provided. In general, trainees worked 
independently, completing one lesson at a time and taking a quiz 
upon completion of each lesson. However, a trainee could take a 
quiz without completing a lesson and proceed to a new lesson if his 
perfomance was satisfactory. The instructor provided assistance, 
graded quizzes, and required trainees to rework missed quiz items. 
Trainees were allowed to go on to a new lesson only when they were 
able to correct their errors. 

Within each section, trainees were randomly assigned to one 
of two treatment groups. One group received the audio supplement 
for Lesson Set F, and the other, for Lesson Set D. (Both groups 
received the standard presentation for the remainder of the course.) 
The experimental design is indicated in Table 1. 



TABLE 1 



Experimental Design for the Parallel Audio Experiment 



With Audio 



Without Audio 



Lesson Set F 
(Fractions) 



Group 1 



Group 2 



Lesson Set D 
(Decimals & Percents) 



Group 2 



Group 1 



Trainees were administered the USAFI and AOQ tests both before 
and after training. For two sections, half of the trainees in each 
treatment group received USAFI Form A as a pretest and Form B as a 
posttest, and the other half received the reverse. For the other 
two sections, the USAFI Form B tests were not available so Form A 
was used both before and after training. This deviation in use of 
tefst forms was not a serious problem since both treatment groups 
were equally affected. 

2» Results 

In determining performance scores, only those USAFI and AOQ test 
items that were covered by the instruction presented in Lesson Sets 
F and D were considered. For each trainee, gain scores were computed 
separately for Lesson Set F and Lesson Set D items. Each gain score 
was calculated by subtracting the number of correct pretest responses 
from the number of correct posttest responses. Two mean gain scores 
and their standard deviations were then computed for each treatment 
group, one for items in Lesson Set F, and one for items in Ijesson 
Set D (see Table 2). 

TABLE 2 

Mean Gain Scores for Lesson Sets Administered 
With and Without Audio* 



With Audio Without Audio 



Liesson Set F Group 1 (N«16) Group 2 (N=16) 
X (SD) 

3.0 (2.19) 2.6 (2.37) 

L_esson Set D Group 2 (N=16) Group 1 (N=16) 
X (SD) 

2.5 (3.59) 3.2 (3.15) 



Note — *One additional trainee was eliminated from the data analysis 
since he failed to complete any of the coursework covered by audio in- 
struction. 

Effects of receiving instruction with and without audio were com- 
pared by use of a cross-over design, a special adaptation of a Latin 
Square analysis with repeated measures (Edwards, 1960). The implemen- 
tation of this design allowed all participants to be represented under 
both conditions of course presentation (with and without audio). Re- 
sults of the analysis are presented in Appendix C • Differences in 
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gains achieved with and without audio were not found to be significant. 



Distributions of responses to an anonymous questionnaire are 
presented in Appendix B. In general, it appears that trainees were 
positively motivated by the course. The great majority of responses 
tended to indicate that attitudes toward mathematics study had im- 
proved, the self-study format of instruction was preferred over 
typical classroom lectures, the length of study sessions was reason- 
able, and the audio instruction was preferred over the unmodified 
coursework. A majority of the respondents indicated that they read 
all workbook explanations carefully most (but not all) of the time. 

3. Discussion 

Despite the fact that a large majority of trainees preferred 
audio-supplemented instruction, addition of audio did not affect 
test performance. The failure of the audio supplement may, in one 
sense, testify to the success of the basic PASS course materials. 
The PASS course was designed to provide instruction with low verbal 
content, and this may have been sufficient to meet the requirements 
of Group IV trainees. 

Attitudes expressed toward course materials and procedures were 
generally positive. The fact that a majority of respondents indicated 
that they did not always read workbook explanations carefully before 
they worked the problems is not viewed as a negative indication. 
Efficient use of instructional materials demands some degree of selec- 
tivity on the part of the learner. 

C. Experiment II; Audio Replacement 

In Experiment I, implementing audio to reduce reading require- 
ments failed to improve performance. In Experiment II, audio was 
used to reduce the visual complexity of presentations. By replacing 
printed instructions with audio, solutions to multi-step problems 
could be presented with greater clarity and unity. 

1. Method 

a. Subjects . Thirty^-eight trainees participated in* Experiment II. 
AFQT percentile scores for these personnel ranged from 11 to 30, the 
mean score being 19.8. 

b. Materials . Again, the written PASS course materials were used 
as a standard form of presentation. An audio version was provided 
for portions of the course covered by Lesson Sets F and D.^ The audio 



^Minor improvements and corrections were introduced followin^^ 
Experiment I but the course basically remained the same. 



version differed from that of Experiment I in that much of the writ- 
ten instructions and explanations were eliminated and reproduced on 
audio tape rather than being presented both in written and in the 
audio format. Sample portions of the standard and audio versions are 
displayed in Appendix D. Test materials were the same as those used 
in Experiment I except that Form A of the USAFI III served both as 
pretest and posttest. 

c. Procedure , Participants were from three different training 
sections, each consisting of from 11 to 14 trainees. Within each 
section, trainees were randomly assigned to one of two treatment 
groups. In contrast to Experiment I, however, one group served as 
a control and received only the standard written materials. The 
other received the audio version both for Lesson Sets F and D. 

Each section was trained separately, following the same general 
training and testing procedures implemented in Experiment I. In 
Experiment II, however. Form A of the USAFI III test was used both 
as a prestest and a posttest to provide a more sensitive measure of 
changes in performance. It is considered unlikely that the utiliza- 
tion of a single test form provided any advantage to the trainees 
since a comparison of gains achieved in Experiment I revealed no 
differences between those who were retested on the same or on differ- 
ent forms U = .1, df^ = 29, £ > .05) . 

2. Resultg 

Using the same calculation procedures described in the results 
section of Experiment I, gain scores covering Performance on Lesson 
Sets F and D were computed for each trainee. Mean gain scores were 
then computed separately for the two treatment groups.^ For the 17 
trainees who received only the standard written materials, the mean 
gain score was 8.8 (SD = 4.31). For the 18 trainees who received the 
audio version, the mean gain score was 7.2 (SD - 3.83). Applications 
of t-tests revealed that, while both groups acieved gains that were 
significant at the .001 level, differences between gains were not 
significant (£ > .05). 

Because a control group was provided in this experiment, it 
was possible to determine whether the effects of audio were measur- 
able in terms of overall course performance rather than in perfor- 
mance over Lesson Sets F and D. Such a result might be expected 
if trainees were saving time on portions of the course covered by 
audio and were consequently able to devote more of their time to 
the portions not covered by audio. 



^Scores of three of the trainees were not included in these com- 
putations since they did not receive any of the instruction covered 
by Lesson Sets F and D. 




Mean gain scores covering all test items were computed for both 
groups. The 17 trainees who received the standard course materials 
had an overall mean gain score of 13.9 (SD = 6.44). The 18 trainees 
who received the audio materials had an overall gain score of 11.2 
(SD = .6.28). Applications of the t-test revealed that while both 
groups achieved significant gains at the .001 level, differences 
between groups were not significant (£ > .05). 

Another point in question was whether the audio treatment caused 
trainees to work with greater independence. A measure of indepen- 
dence was provided in terms of the number of questions trainees asked. 
In working portions of the course covered by audio instruction, those 
17 trainees who did not receive audio averaged 3.1 questions per 
trainee (SD » 4.28). The 18 trainees who received the audio-modified 
course work averaged 1.2 questions^per trainee (SD = 1.83). Because 
of the magnitude of the differences in standard deviations, an F-test 
was performed on the ratio of the variances and found significant at 
the .01 level. A visual inspection of the data revealed that several 
of those trainees who did not receive audio asked a disport ionately 
large number of questions. 

Following completion of the posttests, an attitude questionnaire 
was administered. The distribution of trainees' responses are pre- 
sented in Appendix B. Responses of those who did or did not receive 
audio were quire similar and, for the most part, were in accordance 
with the findings of Experiment I. Trainees continued to be generally 
positive toward the PASS course basic materials and administrational 
procedures and to be selective in their attention to workbook explana- 
tions. Attitudes toward the use of tape recorders were not as gener- 
ally favorable as those expressed in Experiment I. Thus, it was 
possible to examine the relationship between attitudes and performance 
Only 3 of the 11 trainees with pretest scores above the seventh grade 
level (27Z), a compared with 6 of the 7 trainees with pretest scores 
below the seventh grade level (86%), indicated a preference for the 
audio instruction. Application of a chi-square test revealed this 
difference to be significant (X^ = 5.86, p < .05). 

Relating attitudes to posttest achievement, one of the nine 
trainees who achieved the ninth grade criterion (11%), as compared 
with eight of the nine trainees who did not (89%), indicated a pre- 
ference for the audio. Again, the difference is significant (X^ = 
27.56, p < .01). 

A new item was added to the questionnaire for Experiment II. 
Trainees were asked how careful they were about making sure they 
understood why they made an error before they proceeded to new 
material. The large majority of trainees indicated that they al- 
ways did this. These responses contrast with informal reports from 
instructors who had indicated that Group IV trainees appeared to be 
careless about checking and correcting errors. 



3. Discussion 



Again, the addition of audio instruction did not improve test 
gains beyond the levels achieved with the printed PASS course materials • 
The only difference found between groups was in terms of the number of 
questions asked. Some trainees who did not receive audio asked a 
relatively large number of questions. Since none of those who did 
receive audio asked such large numbers of questions, it is possible 
that the taped instructions did influence dependent trainees to work 
with a greater degree of autonomy. 

In general, both treatment groups responded similarly to the 
attitude questionnaire. A majority of the trainees indicated that 
they (1) now felt better about working with mathematical problems, 

(2) read all explanations carefully (at least most of the time) , 

(3) preferred self-study to lecture type instruction, and (4) con- 
sidered the 3-hour work period to be a reasonable length of time. 

In Experiment I, the majority of trainees preferred the audio 
treatment where printed materials were supplemented with audio tapes. 
In this experiment, opinions were more divided. Replacement of 
printed instruction with audio was most frequently objected to by 
the higher performing trainees, possibly because it prevented them 
from being selective in their coverage of the coursework. 

D r Experiment III; 
Withdrawal of Assistance and Extension of Training Time 

Since the application of audio instruction had not established 
any performance advantages, efforts were directed at determining the 
levels of performance effectiveness that could be obtained with the 
standard PASS course materials by varying the levels of assistance 
provided to students and training time. In Experiments I and II and 
in previous studies of Group IV performance with PASS course materials, 
instructors had spent a large proportion of their time providing 
direct assistance, showing trainees how to work missed quiz problems 
and explaining any operations that appeared to cause them trouble. 
Since the elimination of direct assistance would allow instructors 
to work with larger numbers of students, it was considered desirable 
to determine whether this procedure could be followed without ad- 
versely affecting performance. 

In assessing the effects of reductions in assistance, it is 
relevant to consider the dimension of training time. Although the 
PASS course was designed for self-paced individualized study, practical 
considerations necessitated limiting total study time. As a result, 
many trainees were unable to complete the coursework. It was ques- 
tioned, therefore, whether increases in training time would result 
in higher performance gains and compensate for any losses that might 
occur when levels of assistance were reduced. 



1. Method 



a. Subjects , Ninety- three trainees participated in Experiment 
including the 38 trainees referred to in Experiment 11.^ AFQT 

percentile scores for these personnel ranged from 11 to 30, the 
mean being 20, 0, 

b. Materials , Training and evaluation materials were the 
same as those described in Experiment II, 

c. Procedure , Participants were from seven different training 
sections, including the three sections that participated in Experi- 
ment II, Those three sections had received 15 hours of instruction 
with direct assistance from instructors. The remaining four sections 
received training without direct assistance and in the following 
manner: when trainees indicated that they didn't understand how 

to work a problem, the instructor did not demonstrate the solution, 
but referred the student to the portion of the course where that 
particular type of problem was covered. The same instruction 
materials used dn Experiment II were used in Experiment III, but 
trainees could choose whether or not they wished to use the audio 
materials, 

2. Results 

Gain scores covering all USAFI and AOQ test items were computed 
for each trainee in the manner described in Experiment II, Mean 
gain scores were then calculated for the three treatment groups. 
For the 38 trainees who participated in Experiment II and received 
15 hours of instruction vjith direct assistance from instructors, the 
mean gain score was 12,1 (SD 6.27), For the 30 trainees who re- 
cevied 15 hours of instruction without direct assistance, it was 
9,9 (SD " 7,70), For the 25 trainees who received 24 hours of in- 
struction without direct assistance, it was 14,4 (SD « 7,26). Appli- 
cation of t-tests revealed that each of the above gains was signifi- 
cant at the ,001 level. 

A t^^test performed to compare mean gain scores for those who 
received 15 hours of instruction with and without direct assistance 
revealed no significant difference (p > ,05), The two groups that 
received 15 hours of instruction were, therefore, combined for com- 
parison against those who received 24 hours of instruction. The 
mean gain score for the 68 trainees who received 15 hours of in- 
struction was 11,2 (SD = 6,99), Application of a t-test revealed 
that this gain score was significantly smaller than that of the 



ERIC 



^The three trainees who were dropped from Experiment II were 
included in Experiment III since their lack of involvement with 1 in- 
struction covered by audio was not pertinent to the latter study's 
performance comparisons , 
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group that received 24 hours of Instruction (p < .05). 

Because of the breadth of the subject matter and the low Initial 
performance of some trainees, many were unable to complete the entire 
course. Of the 68 trainees who received .15 hours of study, only 
8 (12%) completed the course. In comparison, of the 25 trainees 
who received 24 hours of study, 12 (56%) completed the course. The 
magnitude of this difference Is highly significant (X^ - 19.83, 
p < .001). 

Since the USAFI scores are translatable Into school grade levels, 
It was also possible to analyze performance In terms of grade level 
achievement. Average grade levels of performance before and after 
training, and mean grade level gains are presented In Table 3. Appli- 
cation of t-tests revealed that gains in grade level were signifi- 
cant at the .001 level for all three conditions of instruction. 

In Table 4, trainee achievement is evaluated in terms of the 
proportion of trainees who attained particular grade levels of per- 
formance. The ninth grade level was achieved by one-third to one- 
half of the trainees. The eighth grade level was achieved by ap- 
proximately two-thirds and the seventh grade level by three-fourths 
of the trainees. While these rates of achievement are fairly stable 
over conditions of training, they vary dramatically depending on 
the trainees* initial level of performance. A large proportion of 
those starting at the seventh and eighth grade levels achieved ninth 
grade criterion. However, most of those starting at or below the sixth 
grade level failed to attain even an eighth grade level of performance. 

Grade level achievement was also analyzed as a function of course 
completion. The results of this analysis are graphically depicted 
in Figure 1. While rates of* criterion achievement generally increase 
as a function of level of course completion, differences are apparent 
between the achlvement patterns of those with high and low initial 
grade levels of performance. For trainees who completed 21 or more 
lessons, nearly 90% of those who started at the seventh or eighth 
grade level, but less than 20% of those \Ao started at or below the 
sixth grade level achieved the ninth grade criterion. Less than 50% 
of this latter group were able to achieve an eighth grade level of 
performance. 

Questionnaire responses for the three experimental groups are 
compared in Appendix B. In general, response distributions were 
highly similar. The majority of respondents in each group indicated 
that they felt better about working with mathematical problems, 
read all explanations (at least for most of the time) , t preferred the 
self-study format over classroom lecture, and felt that three hours 
was a reasonable length of time for a study session. 

Trainees who worked without assistance tended to be more neutral 
in their reactions to the audio coursework. Only 3 of the 18 
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CRITERION 
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1-14 



15-20 



2U26 



1-14 



15-20 



21-- 26 



NUMBER OF LESSONS COMPLETED 



Figure 1. Rate of criterion achievement for trainees with differing final 
levels of course completion. 

respondents who received assistance (17%), but 20 of the 42 respon- 
dents who did not (48%) gave a neutral response (X^ = 5.11, p < .05). 
Trainees who did not receive assistance also appeared to be some- 
what less careful about checking their work. Only 16 of the 55 re- 
spondents who did not receive assistance (29%) , but 27 of the 38 re- 
spondents who did (71%) indicated that they always found out how 
to work missed workbook problems before going on to a new lesson 
(X^ - 15.91, p < .01). 

3. Discussion 

Results of Experiment III indicate that Group IV trainees* level 
of computational performance can be improved to a considerable extent 
within a relatively brief time period, even with highly independent 
conditions of study. In classes of trainees with initial levels of 
performance ranging from below the sixth grade level up to the eighth 
grade level, approximately one-third were raised to a ninth grade 
level of performance with as little as 15 hours of training. 

Increasing training time from 15 to 24 hours allowed more trainees 
to complete more of the coursework and resulted in significantly higher 
gain scores. Almost half of the trainees who received 24 hours of 
instruction achieved the ninth grade performance criterion. The 
average gain in grade level for the experimental groups amounted to 
as much as a full year's difference in performance. 

Elimination of direct assistance did not measureably reduce train- 
ing effectiveness nor seriously detract from the generally positive 
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attitudes that prevailed throughout the training sessions. It was 
noted, however > that trainees who did not receive direct assistance 
were less diligent in reviewing missed workbook problems. 

Although audio was not introduced as a variable in this experi- 
ment, some differences in the attitudes of the experimental groups 
toward the use of audio was observed. Trainees who could choose 
whether or not to use audio-modified materials were more neutral 
in their reactions than those who were required to use these materials. 

Even with 24 hours of study, many of the trainees did not complete 
all of the coursework. While criterion achievement was strongly re- 
lated to levels of course completion, the nature of the relationship 
was, to a considerable degree, dependent on initial levels of per- 
formance. Almost all of those who started at the seventh and eighth 
grade levels achieved the ninth grade criterion if they completed 
most of the coursework. In contrast, few of those who started at or 
below the sixth grade level achieved even an eighth grade criterion. 

E. General Discussion and Conclusions 

The performance gains achieved in the present study are impressive 
considering the modest levels of time and assistance that were in- 
volved. Whether PASS course instruction is sufficiently effective 
to prepare the Group IV trainee for his career in the Navy is less 
certain. Although performance levels were raised by as much as a 
full grade level, less than half of the trainees involved in the study 
were able to achieve a ninth grade ".riterion level of performance. 

Most of the operations that must be mastered to achieve a ninth 
grade level of computational performance appear to be relevant to 
the types of skills that Group IV personnel would be expected to 
perform within the Navy. In order to optimize the effective utiliza- 
tion of these personnel, some accoimt of their limitations will have 
to be taken. One possibility is a selective recruitment and assign- 
ment of Group IV enlistees. A seventh grade level of performance 
appears to be an excellent cut-off point for distinguishing between 
those 'who are and are not capable of achieving a ninth grade criterion 
through use of PASS course materials. 

Another possibility worth investigating is whether higher per- 
formance levels may be achieved by limiting training to a single 
occupational area. In the present study, instruction encompassed a 
broad variety of computational operations with applications to many 
different types of tasks. While this may be a reasonable approach 
for providing training to personnel who have not yet been given an 
occupational assignment, a more specific vocational orientation is 
possible once assignment has been made. The Group IV trainee might 
be expected to achieve a higher level of proficiency under such n 
vocational orientation. For one thing, a smaller set of operations 
would probably be involved. For another, it would be easier to re- 
present abstract concepts in terms of concrete values and physical 
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manipulations. Group IV personnel appear to lack a conceptual orien- 
tation, and efforts to emphasize the physical correlates of computa- 
tional operations might be particularly appropriate. 

Finally, if a general background in computational skills is 
determined to be a necessity and selective recruitment is not 
feasible, more effective training approaches will have to be de- 
veloped than those described in the present study. It is not 
immediately evident, however, how training effectiveness can be 
enhanced beyond the levels already achieved. Increasing study time 
raised performance gains by allowing more trainees to complete the 
coursework. However, many of those who completed most of the course- 
work were still unable to achieve target criterion levels of perfor- 
mance. Efforts to improve the effectiveness of coursework through 
the introduction of modifications involving flashcards and audio have 
also been unsuccessful. 

It is felt that further progress will require a determination 
of the nature of the difficulties that the Group IV trainees ex- 
perience in learning to perform computational operations. Some 
preliminary insights were provided by those who worked with the 
trainees in the present study. They observed that the Group IV 
trainee often appears unable to handle information effectively, 
i.e., to follow directions, to retain knowledge, and to monitor the 
correctness of his own performance. These opinions may be worth 
evaluating. The ability to handle information effectively and 
efficiently is critical in the development of any type of academic 
or vocational skill. Efforts to identify and/or improve such abili- 
ties could prove relevant to performance in a broad variety of 
Navy task areas. 
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APPENDIX A 
Arithmetic Operations Quiz 



1. 



205 
X 302 



3. 



10,000 ♦ 100 



5. 



7/715 



Canceling 
5 X la 
5 

we get 



6/8 



2. 



10,000 X 100 = 



4. 



8/984 



6. 



6/700 



8. 



7X5 



10. 



4/5 - 2/5 



1. 



2. 



(a) 61,910 

(b) 6,560 

(c) 8,000 

(d) NG 



3. 



(a) 1,000 

(b) 100 

(c) 10 

(d) NG 



5. 



7. 



(a) 
(b) 
(c) 



5n 



25 
n 
5 

(d) NG 



9. 



(a) 2/4 

(b) 3/2 

(c) 1/2 

(d) NG 



(a) 100,000 

(b) 10,000,000 

(c) 10,000 

(d) NG 



4. 



(a) 114 

(b) 123 

(c) 112 

(d) NG 



6. 



(a) 102 r 1 

(b) 12 r 1 

(c) 10 r 5 

(d) NG 



(a) 
(b) 
(c) 



1,000 r 1 
100 r 1 
116 r 4 



(d) NG 



8. 



(a) 1/7 ♦ 5/7 

(b) 7/1 X 5/1 

(d) NG 



10. 



(a) 6/5 

(b) 2/10 

(c) 2/5 

(d) NG 
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11. 


12. 


11. 




12. 




1 3/4 = 




(a) 


7/4 


(a) 


11 1/3 


14/3 = 


(b) 


3/14 


(b) 


4 2/3 






(c) 


13/4 


(c) 


14 1/3 






(d) 


NG 


(d) 


NG 


13. 


14. 


13. 




14. 




12/4 + 2 1/4 *■ 


2 3/4 


(a) 


4 


(a) 


1 2/4 


- 1 1/4 


(b) 


3 3/8 


(b) 


1 3/4 






(c) 2 1/4 


(c) 


1 1/4 






(d) 


NG 


(d) 

f 


NG 


15. 


16. 


J-D • 




16. 




5/8.30 


9/27 can be reduced 


(a) 


1.30 


(•a) 


1/4 


(b) 


1.36 


(b) 


2/3 


• 


no further than 


(c) 


1.66 


(c) 


1/3 






(d) 


NG 


(d) 


NG 


17. 


• 

18. 


17. 




18. 




12/21 can be reduced 




(a) 


4/7 


(a) 


3/2 


Reduce 21/14 and change 


(b) 


3/4 


(b) 


1 1/2 


no further than 


it to a mixed number. 


(c) 


8/14 


(c) 


1 7/14 






(d) 


NG 


(d) 


NG 


19. 


20. 


19. 




20. 




.05 X 6 = 




(a) 


3.0 


(a) 


.0001 


.001 X .01 = 


(b) 


.30 


(b) 


.01 






(c) 


.03 


(c) 


.00001 






(d) 


NG 


(d) 


NG 



ERIC 



20 



APPENDIX A (continued) 



21. 




22. 


21. 




22. 










(a) 


5/10 


(a) 


.3 








(b) 


5/100 


(b) 


.5 




.5 = 


3/5 - 


(c) 


1/20 


(c) 


.6 








(d) 


NG 


(d) 


NG 


23. 




24. 


23. 




24. 










(a) 


7 


(a) 


6/17 


If: X 


- 10 = 3 


If: 17 - X = 6 


(b) 


13 


(b) 


23 


Then: 


X = 


Then: X = 


(c) 


3/10 


(c) 


11 








(d) 


NG 


(d) 


NG 


25. 




26. 


25. 




26. 




If: 


A = B - C 




(a) 


9 


(a) 


2 


Where: 


B = 5 & C ==-4 


If: 9X - 18 


(b) 


20 


(b) 


9 


Then: 


A = 


Then: X = 


(c) 


4/5 


(c) 


27 








(d) 


NG 


(d) 


NG 


27. 




28. 


27. 




28. 








If: A - ® 


(a) 


2/3 


(a) 


1/2 


If: 


A - B -I- C 


C + D 


(b) 


1 1/2 


(b) 


2 


Where: 


B - 2 & C - 3 


Where: B - 10, C = 2 


(c) 


2 1/3 


(c) 


2/5 


Then: 


A = 


and D — 3 


(d) 


NG 


(d) 


NG 






Then: A = 










29. 




30. 


29. 




30. 










(a) 


70 


(a) 


30% 


Bill's test scores were: 


3/4 - 


(b) 


36 


(b) 


34% 


LOO, 50, 


80, 70, 60. 




(c) 


72 


(c) 


75% 


ais average score ■ 




(d) 


NG 


(d) 


NG 
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31. 






32. 






'^1 




















\^) 


• D 


















(b) 


AC 

. 05 


(b; 


no ^ 


5% = 






25% = 




n 

D . u 


vc; 


HA 














(d) 


NG 


(a) 


NG 


33. What percent of the 


34. 


The edge around 


J J • 




J** . 




square 


is black? 




this rectangle = 






/D/o 




sq.m 














(b) 


o c 

25% 


(b) 


12 in. 












8 in. 


(c) 


100% 


(c; 


O/. 4 

Z4 In. 




B 












(d) 


NG 


(a) 


NG 














4 in. 






























35. Circumference = 


27Tr 


36. 


The area of 


this 


35 • 




36 . 








3.14 


square cornered 


(a) 


1 Q Q/. 


(a) 


o s q . In . 




\ so: 


triangle = 




KJ • £*\J 




A c n ^ n 
H o ^ . Xll . 














vc; 






o In. 


I f -3 m.] r.-f ■rriimfpTPnnP 








(d) 


NG 


(d) 


NG 




y equals _ 


in. 


2 in. 






















4 in. 










37. The volume of 


the 


38. 






J / . 




JO • 




box = 


cu.in. 












Aft 




3 T 0 




















D/o 












6/5 - 




(c) 


26 


(c) 
















6 • 5 


2 in. 




% 








(d) 


NG 


(d) 


NG 






















8 in. 


















39. 






40. 






39. 




40. 
















(a) 


9X9 


(a) 


20/. 06 




9^ means 








6% of 20 = 




(b) 


9 + 9 


(b) 


.06 X 20 














(c) 


2X9 


(c) 


20 + .06 














(d) 


NG 


(d) 


NG 
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41. 



1 2/5 + 3 1/2 



43. 

100 + 10,000 



45. 



.25/ .525 



42. 



3 3/8 
- 1 6/8 



44. 



2 + 5 = 



46, 



50% of 10 + 207. of 10 



47. 



(1/2 of 20)-(25% of 20) 



49. 

Usual price: 
Discount: 
Sale price: 



$24 
25% 



48. 

Interest paid 
in 1 year: 



$30 



Rate: 5% 
Amount borrowed: 



50. 

If the price is $20 
and the tax is 3%, 
then you pay . 



41. 

(a) 4 9/10 

(b) 4 2/10 

(c) 4 3/5 

(d) NG 



43. 

(a) 100 

(b) .001 

(c) .01 

(d) NG 



42. 

(a) 
(b) 
(c) 



1 9/8 
1 7/8 
1 5/8 



(d) NG 



44. 

(a) .04 

(b) .4 

(c) .25 

(d) NG 



45. 

(a) 
(b) 
(c) 



2.1 

20.5 

20.1 



46. 

(a) 
(b) 
(c) 



70% of 10 

70% 

270 



(d) NG 



47. 



(d) NG 



48. 



(a) 3/4 of 20 (a) $150 

(b) 1/4 of 20 (b) $300 

(c) 75% of 20 (c) $600 



(d) NG 



49. 

(a) $30 

(b) $12 

(c) $20 

(d) NG 



(d) NG 



50. 

(a) 
(b) 
(c) 



$23.00 
$20.60 
$20.30 



(d) NG 



23 



33 



ERIC 



APPENDIX A (continued) 



51, 

If: 2/X = 4 
Then: X = 



53. 



5 hr. 20 min, = 



hr. 



55. 

2 cubic yds,= 



cu.f t . 



57. The Volume of the 
box = cu.in. 



1^— s^iin 



\ 6in 



lorn. 



59. 

The ratio of sailors to 
officers - 20 to 3 
for 300 officers we 

will have ^enlisted 

men. 



52. 

If: 

Where: 
Then: 



A = (B + C) 
A = 20, B = 2, 

C = 



54. 



216 sq.in. = sq.ft. 



Area = 1/2 bh 
56. Area = ^sq. in. 




br 3in. 



58. If the area of the 

end equals 5 sq.in., 
the volume of the 
cylinder equals cu.in 



a 



10 in. 



60. 

If you want to travel 
400 miles in 8 hrs. 
your rate of speed 
must average . 



51. 

(a) 2 

(b) 8 

(c) 1/2 

(d) NG 



52. 

(a) 10 

(b) 22 

(c) 18 

(d) NG 



53. 54. 
(a) 5.2 hr. (a) 



(b) 25 hr. 



(b) 



(c) 5 1/4 hr. (c) 



(d) NG 



55. 

(a) 27 

(b) 54 

(c) 6 

(d) NG 



57. 

(a) 
(b) 
(c) 



18 1/2 
120 1/2 
150 



18 

12 

1 1/2 



(d) NG 



59. 

(a) 45 

(b) 60 

(c) 2,000 

(d) NG 



(d) NG 



56. 

(a) 6 

(b) 3/4 

(c) 1/3 

(d) NG 



58. 

(a) 15 

(b) 50 

(c) 2 

(d) NG 



60. 

(a) 
(b) 
(c) 
(d) 



50 mph. 
32 mph. 
20 mph. 

NG 
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APPENDIX C 



Analysis of Variance for Experiment I: 
An Evaluation of the Effects of Audio 
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APPENDIX D 

Samples of Standard and Audio Versions of PASS Course 
Materials Presented in Experiment II 
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